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Apparatus and Methods for Photo-electric Measurement 



DESCRIPTION: 



in a 



can 



Optical imaging combined with spectroscopy is commonly used for the analysis and 
testing of substances and materials, such as chemicals, molecules, cells, tissue, and 
the like, and for measurement/detection of related reactions, processes and events. 
These substances or processes may be arranged in units, hereto referred to 
collectively as "samples", in order to facilitate handling and analysis. In order to 
increase speed, throughput, efficiency and to decrease cost, increasingly large 
numbers of samples are analyzed simultaneously in parallel, or alternatively i 
high-speed serialized fashion, or a combination thereof. In many applications, i 
plurality of samples to be measured are prepared and organized such that they 
be analyzed in an automated fashion, whereby they are placed in or on a "sample 
carrier", typically in the format of an array. The sample carrier facilitates the 
handling, transport and processing of samples. In addition to the measurement of 
samples, it is increasingly important that information related to the samples and their 
related carriers, packaging, etc. be acquired ("read" or "measured"), as well as 
created, tracked, and managed in general. Such "sample information" may exist in 
various forms, including stored on computers, databases, lists, files, stored on 
integrated circuits, barcodes, or encoded onto the samples themselves. 
Furthermore, the said sample information may be directly readable and/or modifiable 
from the object to be measured, for example from sample carriers and/or from the 
samples themselves. 
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Currently the most common examples of applications from the biotechnology field 
include the use of microscopic analysis on microscope slides; sample analysis on 
microplates which can hold commonly 96, 384, or 1536 samples, multi-channel 
electrophoresis, multi-capillary electrophoresis, and cell-based analysis via 
cytometry. One strategy to increase throughput while still conforming to the 
microplate format is to place the samples in an "array of arrays", whereby an 
increased number of samples are placed where a single sample used to be. This 
preserves the investment in automation systems which handle microplates. Recent 
advances in miniaturization include "biological chips (biochips)" and "micro-arrays" 
which accommodate up to hundreds of thousands of samples, whereby the physical 
size and volume of the samples approach the micron and sub-nanoliter ranges 
respectively. Further modern methods involve molecular-based sample analysis or 
processing on miniaturized solid substrates such as on micro-beads. The number 

» 

of samples on one sample carrier is currently approaching a few million. 
Typically the biochemical process is monitored or a result is detected by optical 
measurement, primarily using fluorescence spectroscopy, chemi-luminescence, and 
optical absorbance and/or reflectance, whereby each and every of the mentioned 
samples must be analyzed. The prevalent detection method in the biotechnology 
field utilizes fluorescence, whereby one or more fluorescent labels are used to 
identify, discriminate and/or analyze the samples. 

Current measurement and detection technology in this field are based on: 
a) Imaging, typically using cooled scientific CCD and CID cameras. Such array 
sensors have the inherent advantage of parallelism - that is, they allow the 
simultaneous measurement of a plurality of samples arranged on a plane surface. 
Spectral measurement is implemented by using interchangeable optical filters. The 
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samples are typically Muminated or excited either simultaneously, or by scanning a 
light source over the area. 

b) Scanning systems, typically involving the scanning of a laser over the sample 
carrier area, with measurement using one or more optical sensors such as 
Photomultipiier Tubes (PMT) or Avalanche Photodiodes. Spectral measurement is 
implemented either by using a number (n) of interchangeable optical filters with a 
single sensor, implying that the area to be measured must be scanned (n) times; or 
a plurality of sensors, each used with an optical filter. "Confocaf optical schemes, 
which limit the focal plane of measurement have been used with scanning systems to 
increase sensitivity, and to allow a third dimension of measurement in the °Z" 



or focal 



axis. 



0 Scanning confocal systems which make use of an image sensor such as a CCD 
(Charge Coupled Device) are known. For example, WO 95/21378 discloses a 
scanning single-beam confocal apparatus for DNA sequencing, using a CCD-based 
spectrometer. WO 00/1 1 024 is another such example where multiple laser beam 
excitation is employed with confocal multiple-spectra detection by a CCD 



sensor. 



Current instrumentation have limitations on the size of the area that can be 
measured, the resolution that can be achieved, and the speed of measurement. 
Furthermore, the performance and/or consistency of measurements vary with sample 
position over the area to be measured. Sensitivity decreases as the area (number of 
samples, throughput and speed) increases. 



Imaging systems based on cameras commonly are employing increasingly larger 
image sensors, with as small pixels as possible. This has disadvantages of lower 
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device yields and higher cost; slower readout rates due to the larger number of 
Pixels; optical aberrations in stands* imaging optics are increasingly problematic; 
and the inevitable resolution limit of semiconductor technology. To perform 
spectroscopy, multiple images using various optica, filters are acquired, leading to 
longer measurement time, and lower sensitivity. Laser scanning systems a.so suffer 
from the same optical imaging proDtem s caused by aberrations as the area as well 
as the resolution increases. Demands increase on the precision of the mechanically 
scanning mirror, and reliability and robustness are issues at the relatively high 
scanning speeds. Sensitivity decreases due to the increased time mulOplexing 
inherent in scanning, as well as the use of optical filters. The flatness and tilt of the 
surface or volume to be measured, as well as its positioning relative to the sensing 
system poses a problem as the area gets larger. The resulting variation in focus 
within the measurement area leads to location-dependent performance. 

The object of the present invention is to provide an apparatus and methods for 
optical imaging and spectral measurement of areas and volumes, which solve one or 
several of the above problems. 
This object is solved with the features of the claims. 



The advantages of this invention over prior art are: 

Measurement of large areas: The size of the two dimensional area to be 
measured is theoretically unlimited. On one axis, the optica, measurement unit 
is modularly expandable to the desired length without affecting the speed of 
measurement. Along other axis, either the optical measurement unit moves 
relative to the area to be measured tor any desired lengm, or the micro-optical 
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sensor may be similarly extended in this dimension also. 

According to the present invention many smaller CCD devices are used in 
parallel instead of one large device. For example, as opposed to imaging an 
entire Microplate onto one large, expensive CCD, many smaller fields (perhaps 
each well) can be imaged at lower resolution. Smaller devices have less pixels 
- i.e., lower capacitances - and are inherently capable of running faster 
Through the parallel readout of many devices, overall throughput is greatly 
increased - even if the readout rate is reduced in order to decrease noise 
Smaller devices have higher production yields, and as mentioned above less 
expensive optics can be used. By designing the parallelism modularly the 
throughput can be indefinitely increased without speed penalty. In comparison 
to large devices, there is a limit to increasing the resolution, as the cost of the 
device increases. Speed (frame rate) decreases as the device gets larger 
Since the areas to be imaged are very small and are typically spaced apart (e g 
in the 96-well plate), it is more efficient to use micro-optical arrays. In effect an 
array of objective lenses. 



Better light collection efficiency: Replacing single, larger optical components 
w.th smaller size ("micro-") optics or arrays thereof enables the achievement of 
high numerical aperture and high system etendue. Furthermore, this 
performance can be extended such that it is consistent over an arbitrarily large 
area. By decreasing the field of view and resolution requirements for each 
sensor, the demands on its corresponding optics are lower. It is also easier to 
design more efficient, fast excitation and emission optics. This enables the use 
of micro- or mini-optics. 

It is preferable to use CHARGE MULTIPLYING CCD (hereafter CM-CCD) 
devices (frame transfer type of CCD), which can detect single-electrons at high 
speeds. This is achieved by multiplying the charge packets on-chip, before they 
are read at the CCD output. Granted that at high readout and frame rates the 
read noise of the output is relatively high, one detected electron is multiplied 
with a gain high enough to produce a signal much greater than the read noise 
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This newer technology allows novel and radically different approaches in 
companson to using deep-cooled CCD cameras with extremay low noi e 
together with long integration times. Se 



Enables confoca. optica, system: By replacing a single imaging optics 
essentially with one or more smaller optica, system(s), each of the latter is able 
to funCon as an individual confoca, system. The inherent advantages of 
confoca, systems include lower background signal and .he capability to perform 
3-d,mens,ona, ,maging of volumes. This invention furthermore enables L 
implementation of an "adaptive" confooal system which can adapt to 
unevenness and tilt of the area or volume to be measured. 

Low background signa,: In the case o, fluorescence spectroscopy where high 
sen ittvtty ,s requ.red, "background" signa. often sets the limit of detection This 
background largely originates from undesired light such as fluorescence (e a 

Zl TT ° arrier ' rea9en ' S ^ C ° n,a,n ' he - 

samp as wh,ch are no, being measured), and from scattered or stray light This 

invent,™ reduces background by illuminaflng (exciting) as we., as coning 
,.gh on,y from the po,n, to be measured. Furthermore, by implementing a 
confooal system background is further eliminated by confining the light 
collection to a defined focal plane. 

This invention further decreases background via "gated fluorescence 
spectroscopy", whereby fluorescence is collected during its decay .ifetime when 
the illumination (excitation) is off. 

Ability to optimize spectral bands: Programmability of the width of spectra, 
bands to be measured a„ows optimizing of sensitivity vs. spectra, resolution In 

ZZ 2 T1 sensi,ivity is aohieved when ,he entire ~ * ~ 

together ,n«o a single measurement. This can be done via charge binning on 
the sensor, which minimizes noise. 

High speed: A plurality of relatively small spectrographic ar ray sensors operate 
m parallel a, h,gh speeds. The number of such sensors with associated 
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miniaturized optics can be modularly increased indefinitely to accommodate 
large measurement areas without compromising speed. As opposed to using 
one large, slow array sensor, this modular use of an array of smaller sensors is 
faster particularly as the measurement area increases. 
Consistent performance over the area/volume to be measured: 
The efficiency of illumination (excitation) and light collection of the scanning 
optical measurement system is consistent over the entire area to be measured 
This provides higher reliability and quality of data from samples. The modular 
optical system, and/or scanning along an axis replaces a single standard 
imaging system, eliminating common location-dependent problems such as 
those caused by vignetting and optical aberrations. 

Spectral imaging with high spectral resolution or programmable spectral bands- 
The compact, miniaturized optical system integrates optional diffractive 
elements, which together with the array sensor allows a digitized spectrum to be 
measured. This is more efficient than using optical filters, and is faster since all 
wavelengths are simultaneously acquired. Furthermore, the apparatus allows 
full programmability of the readout of the array sensor, so that the spatial 
location of samples as well as the spectral bands to be measured can be 
changed, optimized and/or calibrated in real time. 

Ability to perform measurements in many modes, and/or to operate in a plurality 
of modes simultaneously: This can be useful for performing real-time 
optimization such as auto-focus or sample location (via imaging) while 
performing spectroscopic measurements. 

Spectroscopic measurement of a plurality of discrete detection points (samples) 
widely spaced within a relatively large area. There may be large "dead spaces" 
between the detection points. This is useful for example when analyzing 
samples in microplates, or lab-on-chip applications where samples may be 
analyzed via electrophoresis in micro-fluidic channels. In the latter, detection 
points may be as small as tens of microns and spaced many millimeters or 
centimeters apart. 
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Lower cost 

Allows ,he use of standard size array sensors. Using a plurality of avaiiabie 
smaiier sensors is a more cost-effective soiution since the volumes for the 
dev,ces increases, producfion yield for smai. devices with ,ess pfcels is higher 

ZTrT °' miCr °" 0P,iCS ' WWCh ™» be -™ - inexpens e 
repeated parts repiaces expensive high performance imaging op,L 

High reliability and robustness 

integrated miniaturized optica, systems are inherently more mechanically 
stabie, less susceptible to dust and dirt. A fully solid-state system eiiminates 
vacuum tubes (for example photomuitipiier tubes), mechanical Alter wheels 

ZZT mw allows t0,m - ,or examp,e in — 

"Sample-Based Detection": 

This invention allows the apparatus to be programmed, controlled and 
optimised by the user on a "sampie basis" - to think and to optimise the system 
,n terms of the application's goa, .or each and every individua. sampie to be 
measured - i.e., achieving best and most reliable sample analysis results 

IT~T T 0P,irniSa " 0n 00CUrS reaM ' me fashi °"- ^is 

is a systems-based approach, in which the invention goes beyond generating 

.mages and deiivering pixel values. For example. In spectroscopy appiications 

In T 7- TT Pr ° 9rammed t0 ° PWmiSe ' he Spe0tral binni "9 «• -n^ivity ' 
on an individual sample-by-sample basis. 

Compact, light detection unit suitable for mounting on moving robotic axes The 
space required for the sensing unit in an optical system is minimal. 

ZZT ' nVenti0n ^ " 3 nUmb6r °' ,ar "' — « 
Biotechnology Instrumentation 

Pharmaceutical (Drug discovery, High Throughput Screening) 
Clinical lab automation 
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Medical Diagnostics, Medical Instruments, Telemedicine 
Agriculture 

Animal husbandry 

Environmental Monitoring and Controls 

Law enforcement, Human Identification, Forensics 

The invention is especially suitable for meeting the demands of high-throughput 
applications in which a plurality of miniaturized samples to be measured are iocated 
over a very large area or volume. Such applications include spectroscopy- 
microscopy; biochemical assays; processes and reactions on miniaturized formats 
(such as those involving micro-/nano-plates, micro-formats & micro-arrays 
chemistry-on-chip, lab-on-chip, micro-channels and micro-fluidics, where dimensions 
of the samples are on micron scale and volumes are in the sub-nanoliter range) 
Typ.cal "sample carriers" which hold a plurality of samples are microplates, gel 
plates, microscope slides, or a plurality thereof. 

The invention is now described with reference to the preferred embodiments and the 
drawings, in which: 

Figure 1 shows an overview of an embodiment of the apparatus according to this 
invention in block diagram form. 

Figure 2 shows an embodiment of a micro-optical design for the apparatus according 
to this invention which allows the use of a single or a plurality of available array 
sensors. 

Figure 3 shows an embodiment of the micro-optical measurement unit of the 
apparatus according to this invention. 

Figure 4 shows an embodiment of a micro-optical design of the apparatus according 
to this invention for confocal measurement. 

Figure 5 shows an embodiment of a micro-optical measurement unit of the apparatus 
according to this invention whereby excitation (illumination) of the target object is 
variable through spatial light modulation . 



WO 2004/106874 

PCT/EP2003/005758 



10 



Figure 6 shows an embodiment of the micro-optioal measurement unit of the 
apparatus according to this invention with simultaneous multiple mode operation 
which enables real-time adaptation. 

Figure 7 shows an embodiment of a means for separating light into its wavelength 
components based on the use of a binary grating. 

Figure 8 shows a first embodiment of a means of acquiring two-sided spectral 
information using image sensor(s). 

Figure 9 shows a second embodiment of a means of acquiring two-sided spectral 
information using image sensor(s). 

Figure 10 shows a third embodiment of a means of acquiring two-sided speotrai 
information using image sensor(s)» 

Figure 1 1 shows a fourth embodiment of a means of acquiring two-sided spectral 
information using image sensor(s). 

Figure 12 shows a fifth embodiment of a means of acquiring two-sided spectral 
information using image sensor(s). 

Figure 13 shows a sixth embodiment of a means of acquiring two-sided spectral 
information using image sensor(s). 

Figure 14 shows a seventh embodiment of a means of acquiring two-sided speotrai 
information using image sensor(s). 

Figure 1 5 shows an embodiment of a means of performing gated detection using 
image sensor(s). 

Figure 1 6 shows an embodiment of a method for performing gated detection. 



The present invention provides an apparatus and methods for photo-electric 
measurement such as imaging and spectroscopy from objects which present large 
areas. The apparatus particularly provides miniaturized optics and/or optical 
component arrays with a single or a plurality of optical sensors, preferably image 
sensors, and other related components such as light sources into a compact and 
sens.t,ve optical measurement unit. Any desired size of the area to be measured is 
accommodated, with consistent performance over the entire area, selectable spatial 
and spectral resolution and high speed. "Hyperspectra." imaging/measurement in 
up to six dimensions can be performed - with high resolution in two dimensions 
(area) or three spatial dimensions (volume), intensity, wavelength and time In 
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particular, the higher speed operation enabled by this invention allows adequate 
resolut.on in the time axis for many applications such as the measurement of 
chemical reaction kinetics. The invention is also suitable for spectral measurement 
and/or imaging of a plurality of objects which are widely spaced (including in arrays 
or "arrays of arrays") within a relatively large area. Gated fluorescence spectroscopy 
and/or fluorescence lifetime measurements are possib.e. The apparatus is capable 
of operating in various modes and combinations thereof, such as imaging, scanning 
"Time Delayed Integration", scanning spectroscopic, or confocal. 

The apparatus or a plurality thereof is further preferentially used in conjunction with 
or integrated with, a "controller", which is preferably the "intelligent detector" and ' 
.mage sensor device(s) according to Patent Application No. PCT/EP01/1 1 027 filed 
on September 24, 2001 , titled "image Sensor Device, Apparatus and Method for 
Opt.cal Measurements". The invention thereby enables high-speed real-time 
adaptive sensing with closed-loop feedback controls. As a particular example 
measurements from surfaces which are uneven or tilted with respect to the optical 
measurement unit can be performed, since real-time adaptation (e.g. of focus) is 
enabled. The functionality and operational modes of the apparatus, particularly the 
individual readout mode(s) of the sensor(s) and acquisition timing, are real-time 
programmable by the said intelligent detector. 

« 

According to a preferred embodiment of the invention multiple CM-CCDs are used as 
needed for any specific configuration. The CM-CCDs can be cooled and hermetically 
sealed in a multi-chip module if necessary. The data streams from the CM-CCDs are 
combined in the camera into one interface to the host. With optional data processing 
in the camera (e.g. via hardware logic or a Digital Signal Processing (DSP) system) 
data can be immediately reduced and the information content maximized For 
example, all pixels with no information content can be immediately discarded and 
the sample information reduced to essential results such as the intensity, standard 
deviation, etc. 

According to a first approach the invention performs parallel imaging of each Region- 
Of-lnterest (which may correspond to "wells" of a microplate) with a high resolution 
For each well, a dedicated miniaturized optical system and CM-CCD device is used 
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According to the required throughput vs cost ronctro^^ 

dup li0 a«ed ,n,o an array. A coxlL^ZZ^l £T" " 

a, a time, and ,o step (index) through a„ L^Z o^^ZZ " "* 

Microplate format, either 8 or 12 spots wou,d L • T °' * 96 - We " 

h«,„ ■ . be lma 9 ed simultaneously There sr. 

two techniques to perform imanir.,,. «e>. are 

Integration" Sten sJ . , 9 ' P " SCa " ima9in9 " and "T™ Delay 

integration . Step Scan Imaging, a parallel row of CM-CCDs tak» „ . . 

row of wells. Either the plate or the d» tort - snapshots" of eaoh 

me piate or the detection system is stepped until all row« .„ 
measured. Note that the frame transfer architecture of the CM CCD ^ 
integrate the next row while reading the current on. ,7 ° 
collection duty cycle" and therefore the ^ ~ ~ T *° 
each well a, its highest resoiution and h.ghes, frame' I 
integration mode, the scanning occurs continuous*, and the rows oHhe CM CCD 
aro synchronized to and clocked synchronously with the meohanlca, sea n ng 
According to a second approach the invention performs hyper-spectral scalnn . 
each we, Hyper-spectra, scanning has the advantage Z 
emission is digged. A line is excited, and the emission pe 1~ L"! 
measured „ is possibie to select the wavelength hands or LJllZ^ 
The signal ,n these bands are binned (summed) directly on-chip thereby incl 
sensitivity and speed, and greatly reducing data volume ,n this a IZ2 

scanned using a CM-CCD, where the vertical dimension of the cIccd Is used a 
the spectral axis. The horizontal dimension of the CM-CCD is the spatia, a *s 1 
represents the Vidth" of the scan - I.e., the width o, the we, This e ^ th ^hl 
emission opt cs include a sDertmnranh k • „ 'quires mat the 

. . . _~ 3 s P ectro 9raph, typically a diffractive element The use nf 

s~ n r : r op,ica ' arrays * appropriate - The »- ~ 

spectra scanning ,s to scan one dimension of the plate at a time. Speeds achievable 
for continuous scanning of spectra are for examp.e for continuous rea^Tt 

rzir 5000 im ° r •* — — - -,ir li 

Again, the frame transfer architecture of the CM-CCD allows to integrate the n„v, r 
w«e roading the current one _ ^ ^ ^ J ~ « £ 

therefore the overall sensitivity. V d 

Figure 1 shows a block dlagiam o, an embodiment o, the apparatus 1 according to ,h,s 
invention ,„ a typlca, appllcaUon. Referring to Figure 1 , the apparatus 1 pe^s optica, 
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measurements of the area or volume presented by the target objeot 1 6 The 
apparatus comprises an optioal measurement unit 2, consisting of a "micro-opticat 
system- 3. a singie or a piuraiity of sensor(s) 4, preferabiy image and/or array 
sensor s ; an optionai system 5 for cooling and/or temperature stabilization of the 
sensory sensor electronics 6 and, when present, the cooling system. The micro- 
opttcal system ,s a compact optica, system which, in its mos, preferable form 
integrates one or any combination of refractive, diffractive, reflective, absolve 
elements, fiber optica,, and/or spatially fiHering elements, and/or one or more "ays 
hereof. Part,cu,ar,y, I, may iriciude mlcro-lenses, spatia, iigh, moduiaj C h T 
Nu,d crystal (LCD) and micro-mirrors, and/or one or more arrays thereof 
Furthermore, the optical functionality of the micro-optical system may be spatially 

fo "ir mea ~ °' various ,ypes can be simui, ~'v UL 

For example, ,mag,ng of the target object or portions thereof may be performed in 
particuiar loca,,on(s,, simuitaneousiy with spectra, measurement in anTeHoc! on 
The apparatus may add,.iona,,y comprise a light source 8 such as a laser laser ' 
d,ode, ,amp, or the like; and its reiated electronics 7, which may be electric* 
connected 1 1 to a controller 10 and/or electrically connected 9 to the sensor 
electron.es 6. The apparatus may also additionally comprise a controller 10 and/or 
components 12 which may Influence ,he measurements. The controiler prefer^ 
has a h,gh-speed tnterface 1 1 ,o .he optica, measurement unit 2 as well as Ihe 
components 12, in order to perform reaMime adaptive functions. The controller 
further prov,des communication 1 5, for example preferably with a host computer or 

it" v t h!r h e ; a " y ' the ,ar9et o *°* may be excited (i,,uminated ' * 

pam 17 by the hgh, source, and the measurement is performed by the sensors via a 
gh. coilecon path 18. The said excKation optica, path may preferab* included 
sa,d m,cro-op„cs or may be associated with a separate optica, system, may be 
mcden. on the object to be measured from any direction, including paths coaxial or 
partially coaxial with the collection path. 

Figure 2 shows an embodiment of a micro-optical function of the apparatus 
according to this invention which allows the use o, a single or a plurality of available 
ar,y sensors. Referring to Figure 2, one axis o, measurement is shown, whe y 
the same concept applies to any number of axes. The micro-optic system 3 allows 
any des,red length of the axis(axes, of measurement on the object 16 in than 
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optically separates optical signal from along the said axis/axes into a plurality of 
smaller segments. Ugh, from each of these segments is then measured by an arrav 
sensor. The segments of light 21 , to 21„ a. the sensor are preferably projections of 
corresponding adjacent or overlapping segments 20, to 20„ on the object being 
measured. This enables the use of "available array sensors" 4, 4, 4 | . 
those which are readily commercially available as opposed to custom-made or" 
application-specific, since it permits space between the active areas 22 of the 
sensors. "Available array sensors" typically consist of semiconductor die(s) which 
are housed in an integrated circuit package. When such sensors are placed 
adjacent to each other in an array as Cose as possible, there is significant space 
between the active sensitive areas. Alternatively, "buttable" array sensors which 
can be arranged in such close proximity ,o each other so as to minimize the dead 
space between their active areas, may be used. The magnification of the system 
may ba less than one, as implied by the dashed lines representing light paths in 
Figure 2, or may be one orflreater. This implies that very high resolution 
measurements of the area can be achieved. 

Since the functionality o, the measurement unit may be spatially variable, sample 
information can be acquired from the sample carrier or from the samples themselves 
( e.g. reading barcodes using scanning imaging mode) while spectral measurement 
of the samples is simultaneously performed. 

Such a compact measurement unit which scans in one axis lends itsel, to robotics 
and high throughput processing o, arrays of sample carriers. Since it Is not a lame 
optical system in a fixed position, it allows for convenient access to the sample 
carried) for other processes such as pipetting, chemical processing, electrical 
contacting, fluidics and the like. 

Figure 3 shows an embodiment of a micro-optical measurement unit of the apparatus 
acoordmg to mis invention which can accommodate any desired size of the area 30 
to be measured. Two or three dimensional imaging and/or "hyperspectral" imaging is 
performed by the mechanical movement o, the measurement unit along one axis 32 
and a modular expansion of the measurement unit in a second axis 31 Three ' 
dimensional (volume) measurement may be achieved preferably through the use o, 
confocal optics (as described in Figure 4), which allows the measurement to be 
limited to a particular depth of focus in a third axis 44. As shown, measurement is 
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performed at the position indicated by the dashed line 34 (hereto "measurement 
line") on the measurement area, this line spanning any desired length of the axis 31 
In this axis, the optical signal to be measured is segmented as described in 
conjunction with Figure 2 by the micro-optical system 33 (micro optics 3) The said 
measurement line may be wholly or in part optically excited (illuminated) whereby 
the said excitation may be incident onto the area from any direction. The micro- 
optical measurement unit comprises a micro-optical system 33, a single or a plurality 
of array sensors 41 1( 41 2 , ... 41 n , optional thermo-electric (Peltier) cooling 42 for the 
sensor(s), a housing 43 and related electronics (6; Fig. 2). The micro-optical system 
efficiently collects optical signal from the measurement line as shown by the rays 35 
via a light collecting means 36 with high numerical aperture. The micro-optical 
system may include: 

a) a means 37 for coupling excitation light through the micro-optic system and onto 
the measurement line as described in conjunction with Figure 5, 

b) a means 38 of selectively filtering unwanted light, such as absorptive, reflective, or 
interference optical filters, or the like, 

c) a means 39 of separating the light into its wavelength components, such as a 
grating or prism, or the like. 

The micro-optical system further comprises a focusing means 40 for focusing the 
collected light onto the sensor(s). The housing provides a rugged, mechanically 
precise and stable basis for the measurement unit. The micro-optical system is 
preferably an integral part of this housing, forming an enclosure and functioning as 
an optical port or window. Furthermore, the micro-optical system may be 
hermetically sealed onto the housing. 

The sensor(s) may be cooled and/or temperature stabilized, preferably by 
thermoelectric (Peltier) cooler(s). In embodiments where the sensor is cooled below 
a particular temperature, the said enclosure is hermetically sealed. The sensor 
related electronics may be inside or outside the said enclosure, or both. Its 
preferred functionality includes communications, power supply, timing controls 
drivers, temperature measurement and regulation, signal processing, input/output 
and control functions. The optical signals are preferentially measured by an image 
sensor such as a CCD (Charged Coupled Device), CMOS (Complimentary Metal 
Oxide Semiconductor), CID (Charge Injection Device), or the like. In order to 
maximize performance, sensor features including one or more of the following are 
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preferred: 

a) Fast clearing of all or a portion of the pixels, such as the clearing of the entire 
device and/or the serial (readout) register with a single pulse 

b) Frame Transfer or Interline transfer architecture, for increased light collection duty 
cycle and decreased blurring. 

c) Random access to pixels increases speed and allows real-time adaptive sensing 

d) Microlenses to increase full factor. 

e) Multiple serial registers, split serial registers and/or multiple outputs increase 
speed. 

f) High shift rates in both horizontal and vertical directions, enabled by sensor 
features such as metal strapping of gates and polysilicon connections, reduction of 
d,stnbuted resistances and capacitances of connections, driving signals on the chip 
from multiple locations. 

g) Summing wells at each output, which allow programmable pixel binning without 
noise penalty. 

h) Anti-blooming in the active area, storage area and/or serial register(s) 

i) Segmentation of the device(s) into a plurality of sub-areas of pixels, whereby the 
sub-areas may be read and/or controlled individually and/or simultaneously 



figure 4 shows an embodiment of a micro-optical system design 50 of the apparatus 
according to this invention for confocal measurement. Here only the functions 
add,t,onal to those in Figure 3 are described. In this embodiment, the light collected 
from the measurement line is re-focused by a focusing means 53. At this focal point 
a means of spatially filtering 54, preferably in the axis perpendicular to the 
measurement line, is placed. This means of spatially filtering preferentially consists 
of a spatially varying layer (mask) which selectively prevents light from continuing on 
to the sensor, and may accomplish this function by means of absorption, reflection 
refraction, and/or diffraction. The light is collimated by a means 55 , may be further 
filtered by a filtering means 38, may be separated into its wavelength components 
by a means 39, such as a grating or prism, or the like. The resulting optical signal to 
be measured is focused onto the sensor(s) at the plane 56. As depicted in Figure 4 
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the spectrum (spectra) 57 originating from point(s) 51 on the target object is/are 
preferentially measured by one or a plurality of region(s) on the sensor 58, whereby 
the corresponding sets of pixels can be programmably defined or changed in real 
time. The signal contained by these pixels may be "binned" or summed on-chip 
The sets of pixels may represent various wavelength bands from samples being 
measured. The said programmable region(s) allow spatial filtering in two dimensions 
of the signal from desired point(s) on the measurement line. 

Figure 5 shows an embodiment of a micro-optical measurement unit of the apparatus 
according to this invention whereby excitation (illumination) of the target object is 
variable through spatial light modulation. This is particularly useful for adaptive 
optimization of the excitation of samples, which is a method of increasing the 
consistency and dynamic range of measurement, and for selective photochemistry 
(e.g. catalyzing of reactions). Excitation (illumination) light 52 preferably following a 
path with the form of a line is spatially filtered in one or two dimensions by a filtering 
means 60 and focused onto the measurement line 34. The spatial light modulation is 
preferably real time programmable. This excitation light may be preferentially coupled 
through the micro-optic system by a coupling means 37, which influences the light by 
means of reflection (e.g. mirror, dichroic filter), grating, and the like. The said 
programmable spatial filtering is preferably a "spatial light modulator (SLM) which is 
preferably an integral part of the micro-optic system, which may utilize Liquid Crystal 
Display (LCD) technology, micro-mirrors, acousto-optics, or the like, and which may 
be capable of varying the intensity of the transmitted light. The excitation light may 
be spatially continuous along the direction of the measurement line 34, may consist 
of a single or a plurality of beams, and/or the said beams may be mechanically 
moving (scanning). 

r 

Referring to Figure 6, this embodiment of the micro-optical measurement unit 
illustrates simultaneous multiple mode sensing operation. This enables real-time 
adaptation during the measurement process, providing benefits such as: 
a) optimization of the measurement via methods such as automatic positioning (X, Y 
and focus) of the measurement unit, location of samples and corresponding 
adaptation of the readout mode(s) and acquisition parameter(s) of the sensor(s). 
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b) measurement from tilted areas (non-parallel to the plane of movement of the 
measurement unit) 

c) acquisition/modification of information from the sample carrier and/or from the 
samples themselves simultaneously while measuring the samples. This sample 
information may also be used in real-time to optimize the measurements. 

The measurement unit measures the target object or sample carrier 30 via 
movement in the direction 32. The target object preferably incorporates one or a 
plurality of particular area(s) 75 which provides the apparatus read and/or write 
access to information. A first portion or multiple first portions of the optics 71 and 
corresponding sensing 73 of the measurement unit is/are applied to acquiring 
information from features on the target object, such as fiducials 76 , markings 79, 
reference signals 80, barcodes 78, and the like. In the example shown in Figure's 
both sides of the measurement unit comprise a first portion. Second portion(s) of the 
optics 72 and corresponding sensing 74 of the measurement unit may be applied to 
the simultaneous, optimized measurement of samples. The measurement unit 
preferably may be spatially positioned with respect to the target object by positioning 
means 87, which is preferably under high speed feedback control of the controller of 
the apparatus. The functionality denoted by blocks 81 through 86 is implemented in 
the electronics 6, 7 and controller 1 0 of the apparatus, as described with Figure 1 . 
Two measurement lines are depicted, with corresponding optics 70, and 70 2 , 
whereby a single or a plurality of measurement lines may also be implemented. 
As a first example, the apparatus can scan (image) fiducial markings on the target 
object, thereby calibrating the location of samples. 

This information is processed by an algorithm 83. The measurement of the samples 
can immediately be optimized by programming the sensor(s) readout modes 
optimally via sensor controls 81 , 82, by position control 84 and 85, and/or by 
controlling other parameters 88 such as light source. The samples are therefore 
more optimally measured, whereby the results can be further processed by a second 
algorithm 86. For example, the set of pixels on the image sensor containing light 
from each sample 88, or from each desired wavelength bandwidth of each sample 
can be determined in real-time (during the measurement process), and summed on- 
chip ("pixel binning") in order to increase sensitivity. 

As a second example, the apparatus can measure features on the target object such 
as stripes 77 in the scan direction to gain focus and positional information. The 
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apparatus then performs real-time positional adjustment via position adjustment 
means 87 to "track" the uneven surface, optimizing its spatial position (particularly 
focus) relative to the target object. - 

As a third example, the apparatus includes two or more positions (lines) of 
measurement, sequentially positioned in the scan direction. This allows a high 
degree of measurement optimization, since the following measurement line(s) can 
use the apriori information from previous measurement lines for optimization For 
example, a first measurement line performs imaging of the target object These 
images are immediately processed, and the information used to optimize the 
measurement system before a second measurement line performs measurements 
Parameters such as focus, scan speed, excitation intensity, exposure time, sensor 
readout mode and the like can be optimized. 

Furthermore, multiple measurement lines allow imaging and spectral measurement 
of the area to be done in one scan. 

Figure 7 shows an embodiment of a means for separating light into its wavelength 
components based on the preferable use of a simple one-level binary grating 39 
The slrts of such a grating may be created lithographically using a single mask (e g 
by e-beam lithography), and may be inexpensively replicated. The grating separates 
a collimated beam of light 90 into a "two-sided spectra", comprising essentially of the 
zeroth 95, plus one 93 and minus one 92 spectral orders. These are focused onto a 
sensor plane 91 by a focusing means 40. A typical Laser-induced fluorescence 
spectral pattern is depicted in Figure 7, whereby the laser wavelength is shown by 
94, and 94 2 . It is known that approximately 40% of the incident energy is contained 
.n the plus one spectral order, and 40% in the minus one order. By collecting both of 
these orders, an overall efficiency of approximately 80% can be achieved which is 
typically better than state-of-the-art blazed holographic gratings. Furthermore, such 
s.mple binary gratings are particularly suitable for integration into micro-optical 
systems. 

Figure 8 through 14 show various embodiments of the means of acquiring two-sided 
spectral information using image sensor(s), whereby one of possibly a plurality of 
sensors is shown. Two sided spectra are shown projected onto the active (light 
sensitive) area 100, although this may be any image generated by the measurement 
unit The plus one and minus one spectral orders are projected onto areas 98 n and 
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98a., whereby the spectra originating from individual samples are shown by 1 06 
108* ...108. .The spectra of each sample may be measured using one or a plurality 
of programmable sub-areas 101. Since the plus one and minus one orders are 
m,rror images of each other on the sensor, these two halves of the spectrum to be 
measured may be recombined (added together) either by charge combination (pixel 
btnmng) on-chip, by analog summing in the sensor's signal chain, by digital summing 
in the controller of the apparatus, or by software image processing. In the case of 
CCD sensors: 

a) Serial (readout) registers are shown by 102 and 103, whereby the dashed lines 
indicate optionally present features. 

b) Each serial register may be sub-divided into a plurality of segments 104, 104 2 
... 1 04 n , with outputs 1 05!, 1 05 2 , ... 1 05 n . 

c) A summing well at each output, as well as a means for fast clearing of the serial 
register, such as single pulse clearing into a charge drain, are preferable 
Referring to the first embodiment in Figure 8, the image sensor shown may be a full- 
frame or interline transfer type CCD. The latter is preferred in this embodiment since 
.t allows higher light collection duty cycle at higher frame rates, has electronic 
shuttering capability, and reduces blurring. | n the case of two-sided spectra the 
zeroth order 95 located in the area 99 may be ignored, or may be used as a locating 
and calibrating means, or as an input for real-time adaptation for optimizing 
measurements. The two spectral orders can be measured simultaneously 
Referring to the second embodiment in Figure 9, the plus one and minus one 
spectra may be measured using separate image sensor devices 1 1 0 and 1 1 1 This 
ma.nly reduces the sensor area in cases where the distance between the first orders 
is substantial. 

Referring to the third embodiment in Figure 10, a frame transfer type CCD may be 
used to acquire the two-sided spectral information. The active region 1 12 is 
exposed, then shifted quickly under the shaded region 113 (electronic shuttering 
acton). As the shaded region is read via the serial register, the next exposure 
occurs in the active region. 

Referring to the fourth embodiment in Figure 1 1 , a frame transfer type CCD with 
two shaded regions 116, 117 may be used to acquire the two-sided spectral 
information. The active region is divided into two separately controllable regions 114 
and 1 15. In this case, two spectral orders can be measured simultaneously. 
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Referring to the firth embodiment in Figure 1 2, two frame transfer type CCDs 1 1 8 
and 1 1 9 may be used to acquire the two-sided spectral information 
Referring to the sixth embodiment in Figure 13, the image sensor shown may be a 
full-frame or interline transfer type CCD, whereby one or two serial register(s) 120 
1 23 are positioned between the spectral orders to be measured. Light from the 
zeroth order is prevented from being collected by the sensor by a means such as an 
alum.n.um mask on the sensor, or by blocking the light off-chip; i. e. by blocking the 
light by means of a mechanical mask or aperture which is not integrated onto the 
photo-electric conversion device(s). The spectral halves 121, 122 may be 
recombined (binned) directly on-chip in the serial register during the readout process 
Referring to the sixth embodiment in Figure 14, a frame transfer device may be 
used as described in relation to Figure 1 3. 

Figures 15 and 16 shows an embodiment of a means and a method of performing 
gated detection using image sensor(s). Such time gated fluorescence or 
luminescence measurements combined with spectral discrimination effectively 
eliminates background autofluorescence and luminescence, resulting in more 
sensitive measurements. Figure 15 shows an embodiment of time gating at the 
sensor, and Figure 16 shows an example of a related time sequence of events 
during measurement (light collection). Typically a light source with particular 
wavelength characteristics is pulsed 140 for a short time to excite the samples 
Undesirable emitted light (e.g. background autofluorescence) 141 and the emitted 
light 142 to be measured are shown having varying time delays. The excitation light 
.s sensed by one or a plurality of sensing means 131,, 131 2 , ...131„ , and detected 
by a detection means 1 32. The sensing means and/or the detection means may 
preferably be integrated on the image sensor chip or may be implemented off-chip in 
the measurement unit. Based on the detection of this excitation light, the detection 
means generates a "gating input" signal 143 to an acquisition control means 133 
which then enables (gates) the acquisition of emission spectra by the image sensor 
After the majority of the desired emission is acquired in an active area, the 
acquisition control means then stores or adds 144 this signal to others previously 
collected in a storage region which is shielded from incident light. The signal level 
acquired 145 in this storage area therefore increases with every excitation pulse. At 
the end of the measurement time, the storage region is read. Discrimination 
between background autofluorescence and desired emitted signal can also 
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simultaneously be performed based on their spectral differences. Furthermore the 
said active areas and corresponding storage areas may be implemented on a pixel 
basis. 

Since the time delays involved typically range from a few nanoseconds to hundreds 
of m,croseconds, the speed of operation of the excitation sensing, gating and 
acquisition control means is maximized by preferably integrating these on the image 
sensor itself, or alternatively very close to the sensor in the measurement unit 

An example of the application of this invention for spectral measurement of a plurality 
of objects which are widely spaced within a relatively large area is the simultaneous 
measurement of multiple electrophoresis micro-channels on a microplate or "lab-on- 
chip". In this case, the measurement unit may include a minimum number of small 
image sensors arranged along a first axis to acquire the number of measurement 
points in a row along this axis. In a second axis, the measurement unit is moved in 
steps, between rows of measure points. By using a repetitive scanning motion over 
the area, all measurement points can be simultaneously measured with a particular 
sample rate. This rate can be increased by modularly increasing the number of 
measurement units operating in parallel. Using the real-time features and multi- 
mode operation of this invention as described above, the measurement quality can 
be improved - for example by optimally positioning excitation into micro-channels 
using the sensor and/or automatically focusing and adapting to tilted surfaces during 
the measurement process. 



